Multi-Sensor  Correlation  and  Quantization  in 


s 

Y  S 

T  E 

M 

S 

R 

E  S  E  A  R 

C 

H 

C 

E  N 

T 

E 

R 

Supported  by  the 
National  Science  Foundation 
Engineering  Research  Center 
Program  (NSFD  CD  8803012), 
the  University  of  Maryland, 
Harvard  University, 
and  Industry 


Distributed  Detection  Systems 


by  Y.A.  Chau  and  E.  Geraniotis 


TR  91-29 


Report  Documentation  Page 

Form  Approved 

OMB  No.  0704-0188 

Public  reporting  burden  for  the  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources,  gathering  and 
maintaining  the  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this  collection  of  information, 
including  suggestions  for  reducing  this  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports,  1215  Jefferson  Davis  Highway,  Suite  1204,  Arlington 

VA  22202-4302.  Respondents  should  be  aware  that  notwithstanding  any  other  provision  of  law,  no  person  shall  be  subject  to  a  penalty  for  failing  to  comply  with  a  collection  of  information  if  it 
does  not  display  a  currently  valid  OMB  control  number. 

1.  REPORT  DATE 

1991 

2.  REPORT  TYPE 

3.  DATES  COVERED 

00-00-1991  to  00-00-1991 

4.  TITLE  AND  SUBTITLE 

5a.  CONTRACT  NUMBER 

Multi-Sensor  Correlation  and  Quantization  in  Distributed  Detection 

5b.  GRANT  NUMBER 

5c.  PROGRAM  ELEMENT  NUMBER 

6.  AUTHOR(S) 

5d.  PROIECT  NUMBER 

5e.  TASK  NUMBER 

5f.  WORK  UNIT  NUMBER 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

University  of  Maryland, Systems  Research  Center, College 

Park, MD, 20742 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

10.  SPONSOR/MONITOR'S  ACRONYM(S) 

11.  SPONSOR/MONITOR'S  REPORT 
NUMBER(S) 

12.  DISTRIBUTION/AVAILABILITY  STATEMENT 

Approved  for  public  release;  distribution  unlimited 

13.  SUPPLEMENTARY  NOTES 

14.  ABSTRACT 

see  report 

15.  SUBIECT  TERMS 

16.  SECURITY  CLASSIFICATION  OF: 

17.  LIMITATION  OF 
ABSTRACT 

18.  NUMBER 
OF  PAGES 

64 

19a.  NAME  OF 
RESPONSIBLE  PERSON 

a.  REPORT 

unclassified 

b.  ABSTRACT 

unclassified 

c.  THIS  PAGE 

unclassified 

Standard  Form  298  (Rev.  8-98) 

Prescribed  by  ANSI  Std  Z39-18 


Technical 

Research 

Report 


Multi-Sensor  Correlation  and  Quantization  in 
Distributed  Detection  Systems 

by  Y.A.  Chau  and  E.  Geraniotis 


SYSTEMS 
RESEAR  CH 
CENTER 


Supported  by  the 
National  Science  Foundation 
Engineering  Research  Center 
Program  (NSFD  CD  8803012), 
the  University  of  Maryland, 
Harvard  University, 
and  Industry 

Research  support  for  this 
report  has  been  partially 
provided  by  the  Office  of 
Naval  Research  under 
Contract 
N00014-89-J-1 375 


TR  91-29 


MULTI-SENSOR  CORRELATION  AND  QUANTIZATION  IN  DISTRIBUTED  DETECTION  SYSTEMS 


Yawgeng  A.  Chau  and  Evaggelos  Geraniotis 


Copyright  c  1991.  Yawgeng  A.  Chau  and  Evaggelos  Geraniotis.  All  Rights  Reserved. 


MULTI-SENSOR  CORRELATION  AND  QUANTIZATION  IN  DISTRIBUTED  DETECTION  SYSTEMS 


Yawgeng  A.  Chau  and  Evaggelos  Geraniotis 


Department  of  Electrical  Engineering 
and  Systems  Research  Center 
University  of  Maryland 
College  Park,  MD  20742 


ABSTRACT 

Quantization  and  fusion  schemes  are  derived  for  multi-sensor  correlation  in  distributed 
K  -sensor  systems  that  are  used  for  the  detection  of  weak  signals  or  general  signal  discrimina¬ 
tion  from  dependent  observations.  The  dependence  in  the  observations  across  time  and  sensors 
is  modeled  via  stationary  m  -dependent,  <j)-mixing,  or  p-mixing  processes.  The  observation 
sequences  of  the  various  sensors  have  identical  individual  statistics  and  identical  pairwise 
statistics  (symmetric  conditions).  Each  sensor  observation  is  passed  through  a  memoryless  non¬ 
linearity  or  quantizer  (the  same  one  for  all  sensors)  to  form  the  sensor  test  statistic;  the  deci¬ 
sion  statistics  of  the  various  sensors  are  then  passed  to  the  fusion  center  in  an  unquantized  or 
binary  quantized  manner  to  form  the  final  decision  statistic  of  the  fusion  center.  Based  on  a 
common  large  sample  size  for  each  sensor  that  is  necessary  for  achieving  high-quality  perfor¬ 
mance,  an  asymptotic  analysis  is  applied  for  the  error  probabilities  of  the  fusion  center.  This 
provides  design  criteria  for  the  optimal  memoryless  nonlinearity  and  quantizer.  Optimization  of 
these  design  criteria  yields  the  optimal  nonlinearity  or  quantizer  as  solutions  to  linear  integral 
eqautions  involving  the  first-  and  second-order  pdfs  of  the  sensor  observations  describing  the 
individual  and  pairwise  dependence.  The  analytical  results  obtained  are  valid  for  any  number 
of  sensors  K.  Numerical  results  based  on  the  simulation  of  the  performance  of  our  schemes 
with  different  number  of  sensors  are  presented.  The  performance  of  the  optimal  nonlinearities 
and  quantizers  is  shown  to  outperform  that  of  nonlinearities  or  quantizers  obtained  by  ignoring 
the  dependence  in  sensor  observations  and  to  improve  as  the  number  of  sensors  increases. 


This  research  was  supported  in  part  by  the  Office  of  Naval  Research  under  contract  N00014-89-J-1375  and  in  part  by  die 
Systems  Research  Center  at  the  University  of  Maryland,  College  Park,  through  the  National  Science  Foundation’s  Engineering 
Research  Centers  Program:  NSF  CDR  8803012. 


I.  INTRODUCTION 


In  most  practical  multi-sensor  detection  systems  with  or  without  a  fusion  center,  the  obser¬ 
vations  are  dependent.  For  each  sensor,  the  dependence  in  observation  across  time  is  usually 
due  to  increased  sampling  rates  or  the  observed  phenomenon  itself,  whereas  the  dependence  in 
observations  across  sensors  is  due  to  the  geographic  proximity  of  the  locations  of  the  sensors. 
Yet,  in  the  earlier  works  on  distributed  detection  and  data  fusion  (see  [l]-[5]),  the  sensor  obser¬ 
vations  were  assumed  to  be  independent  across  time  and  sensors,  primarily  for  the  purpose  of 
making  the  analysis  tractable. 

In  our  recent  work  of  [6]  and  [7],  we  formulated  and  solved  multi-sensor  detection  and 
fusion  problems  with  correlated  observations  across  time  and/or  sensors  of  general  stationary 
m-dependent  or  mixing  type.  In  particular,  in  [6]  we  designed  and  analyzed  quantization  and 
fusion  schemes  based  on  memoryless  nonlinearities  for  the  detection  of  weak  signals  in  additive 
stationary  m-dependent,  (^-mixing,  or  p- mixing  noise;  whereas  in  [7]  we  introduced  and  evaluated 
the  performance  of  similar  schemes  for  general  signal  discrimination  (not  of  the  signal  plus  noise 
type)  from  stationary  m-dependent  or  mixing  observations. 

However,  although  the  formulation  and  techniques  of  [6]  and  [7]  are  quite  general  and  in 
principle  applicable  to  multi-sensor  systems,  the  specific  designs  presented  and  evaluated  there 
were  for  detection  systems  consisting  of  two  sensors  and  a  fusion  center.  In  particular,  the  case 
of  dependence  across  both  time  and  sensors  was  analytically  solved  in  [6]  and  [7]  only  for  two 
sensors  with  a  fusion  center. 

In  this  paper,  we  extend  the  results  of  [6]  and  [7]  to  detection  systems  with  K  sensors 
( K  >  2)  and  a  fusion  center.  We  consider  symmetric  conditions,  under  which  the  sensors  have 
identical  individual  statistics  and  identical  pairwise  joint  statistics.  Asymptotically  optimal 
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memoryless  quantization  and  fusion  schemes  are  derived  for  weak-signal  detection  and  general 
signal  discrimination  problems  with  dependence  in  the  observations  across-time  and  sensors. 
The  results  obtained  are  valid  for  an  arbitrary  number  of  sensors  and  allow  us  to  compare  the 
performance  of  multi-sensor  systems,  as  the  number  of  sensors  increases  and  the  correlation 
in  the  sensor  observations  across  time  and  sensors  varies.  In  deriving  these  new  schemes,  this 
paper  extends  the  useful  and  popular  methodologies  of  memoryless  locally-optimal  detection 
of  weak-signals  and  memoryless  nonlocal  detection  from  the  single-sensor  case  to  the  case  of 
multiple  sensors  with  a  fusion  center,  and  also  advances  earlier  work  in  the  area  dealing  with 
i.i.d.  sensor  observations. 

The  observations  sequence  of  each  sensor  consists  of  (i)  a  weak  signal  in  additive  dependent 
stationary  noise  or  (ii)  arbitrary  stationary  dependent  processes,  under  the  two  hypotheses.  To 
model  the  dependence  in  the  observations  of  each  individual  sensor  and  between  observations 
of  different  sensors  we  use  stationary  mixing  processes,  such  as  stationary  m-clependent, 
^-mixing,  or  p-mixing  processes.  The  definitions  of  these  mixing  processes  and  the  associated 
central  limit  theorems  are  detailed  in  [8]  and  [9].  These  models  of  dependence  have  been  suc¬ 
cessfully  used  in  single-sensor  weak-signal  detection  and  discrimination  problems  (see  [10]-|  13]). 

The  sensors  collect  n  observations  each  (with  n  denoting  the  common  sample  size)  and 
form  test  statistics,  which,  after  (possible)  quantization,  are  transmitted  to  the  fusion  center,  or 
directly  transmit  to  the  fusion  center  a  quantized  version  of  their  observations.  At  the  fusion 
center,  the  information  sent  by  the  sensors  is  processed  further  and  a  decision  is  reached  as  to 
which  of  two  hypotheses,  Hq  or  H\,  is  true. 

As  a  rule,  the  optimal  detection  schemes  under  the  above  models  of  dependence,  for  ei¬ 
ther  single-sensor  or  multi-sensor /fusion-center  configurations,  involve  high-order  (larger  than 
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two)  probability  densities  of  the  observations,  which  are  not  only  difficult  to  characterize,  but 
also  impose  prohibitive  requirements  on  processor  memory  and  complexity  for  the  storage  and 
processing  of  the  dependent  data.  To  avoid  these  complications  in  our  analysis,  design,  and 
implementation,  we  employ  suboptimal  sensor  decision  statistics  and  sensor  quantiza¬ 
tion  schemes  based  on  memoryless  nonlinearities;  the  fusion  rules  employed  at  the  fusion 
center  are  basically  likelihood  ratio  tests  based  on  these  suboptimal  sensor  decision  statistics  or 
quantization  schemes.  These  are  easier  to  implement  and  their  derivation  requires  knowledge 
of  only  the  univariate  and  bivariate  probability  densities  of  the  observation  sequences.  Large 
sample  sizes  are  necessary  for  the  validity  of  the  analysis  and  the  usefulness  of  the  resulting 
detectors;  but  these  are  well  justified,  because  they  are  necessary  for  achieving  high-quality 
performance  in  hypothesis  testing  problems  involving  the  detection  of  a  very  weak  signal  or 
the  discrimination  between  observation  sequences  with  (nearly)  identical  first-  and  second-order 
moments. 

We  now  describe  the  three  schemes  (termed  Schemes  1  to  3)  for  quantization  and  fusion 
in  lif-sensor  detection  systems  with  dependent  observations,  whose  analysis,  optimal  design, 
and  performance  evaluation  (via  simulation)  constitute  the  subject  of  this  paper.  The  same 
memoryless  nonlinearity  g(-)  is  employed  by  all  sensors.  This  is  justified  by  the  symmetric 
conditions  that  we  assumed  characterize  our  problem  and  the  simplicity  of  the  implementation. 
In  general,  the  argument  of  g(-)  is  a  continuous-amplitude  (real)  variable  and  g  can  take  all  real 
values.  (  In  reality,  g  is  implemented  through  a  discretized  form  with  a  large  but  finite  number 
of  amplitude  levels)  When  quantization  is  employed,  g{-)  takes  the  form  of  a  quantizer  and  is 
characterized  by  a  finite  number  of  quantization  levels  and  breakpoints. 

For  Scheme  1  (illustrated  in  Fig.  C.l),  the  fc-th  sensor  employs  the  aforementioned  g,  forms 
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the  test  statistic  Tn^  given  by 


Tn,k  =  -i2g(xlk));  A  =1,2,...,  A-  (1) 

n  i= l 

where  n  is  the  common  (large)  sample  size  and  {x/^}"=1  a  stationary  observation  sequence 
characterized  by  m-dependent  or  mixing  type  dependence,  and  transmits  it  directly  to  the 
fusion  center,  where  a  likelihood  ratio  test  is  performed  based  on  Tn^,  for  k  —  1,2 ,  If 

one  could  reliably  transmit  a  real  number  through  a  bandlimited  channel  (as  are  the  channels 
between  the  sensors  and  the  fusion  center),  this  fusion  scheme,  which  is  optimal  within  the 
class  of  schemes  employing  memoryless  nonlinearities  in  the  sensor  test  statistics,  would  also 
be  practical.  However,  in  reality  we  can  only  transmit  a  finite  number  of  bits  of  information 
through  the  aforementioned  channels.  Therefore,  quantization  of  the  test  statistics  or  of  the 
sensor  observations  themselves  is  of  interest  and  this  is  considered  in  the  following  two  schemes. 

In  Scheme  2  (illustrated  in  Fig.  C.2),  the  observation  xfk^  of  sensor  k  at  time  /  is  first 
quantized  by  a  quantizer  Q  (common  to  all  sensors),  which  is  obtained  from  minimizing  an 
appropriate  design  criterion,  and  then  transmitted  to  the  fusion  center,  where  the  test  statistic 

fn,fc  =  -^Q(X;(fc))  (2) 

n  i=i 

is  formed.  Finally,  the  fusion  center  performs  a  likelihood  ratio  test  based  on  Tnj: ,  for  k  = 
1,2,  •  •  ■ ,  K .  The  optimal  quantizer  is  relatively  simple  to  implement.  Even  simpler  implemen¬ 
tations,  in  which  the  breakpoints  are  uniformly  spaced  over  the  interval  defining  the  support  of 
the  sensor  observations  are  possible  at  the  expense  of  of  some  degradation  in  the  performance. 
For  a  large  number  of  quantization  levels  these  schemes  approximate  Scheme  1. 

In  Scheme  3  (illustrated  in  Fig.  C.3),  the  test  statistic  Tn^  for  each  sensor  is  first  formed 
as  in  Scheme  1  by  the  continuous-amplitude  nonlinearity  g  and  then  quantized  by  a  two-bit 
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quantizer  or  equivalently  compared  to  a  threshold,  in  order  to  decide  which  hypothesis  is  true. 
The  single  bit  (0  or  1)  of  the  sensor’s  decision  (also  termed  a  hard  decision)  is  transmitted  to  the 
fusion  center.  The  fusion  center  performs  a  likelihood  ratio  test  based  on  the  binary  decisions 
of  the  K  sensors. 

As  described  above,  the  function  of  the  fusion  center  is  to  collect  (as  in  Schemes  1  and  3)  or 
form  (as  in  Schemes  2)  the  test  statistics  from  the  information  transmitted  by  the  sensors.  In 
the  design  of  optimal  nonlinearities  or  quantizers  for  Schemes  1  and  2,  we  employ  the  Neyman- 
Pearson  criterion  on  the  error  probabilities  of  the  fusion  center,  whereas  for  Scheme  3  we  employ 
the  asymptotic  rates  of  the  error  probabilities  of  the  fusion  center.  It  turns  out  that  the  final 
design  criterion  for  each  nonlinearity  or  quantizer  has  the  form  of  deflection  for  weak-signal 
detection  problems  and  of  the  generalized  signal-to-noise  ratio  for  discrimination  problems; 
these  are  among  the  most  popular  second-order  measures  of  quality  for  signal  classification  (see 
the  tutorial  in  [14]). 

The  course  of  obtaining  the  optimal  nonlinearities  or  quantizers  involves  solving  linear 
coupled  integral  equations,  which  depend  on  the  univariate  and  bivariate  probability 
density  functions  (pdfs)  of  the  sensor  noise  sequence.  The  optimal  threshold  of  each  sensor 
%  is  determined  by  the  optimization  of  the  individual  design  criterion  for  each  case;  it  depends 
only  on  the  means  and  the  variances  of  the  test  statistics  Tnjk,  under  the  two  hypotheses,  and 
thus  on  the  aforementioned  univariate  and  bivariate  pdfs. 

The  remainder  of  this  paper  is  organized  as  follows.  In  Sections  II,  some  preliminaries 
pertaining  to  the  detection  of  weak  signals,  to  general  discrimination,  and  to  all  the  quanti¬ 
zation/fusion  schemes  considered  in  this  paper  are  provided.  In  Section  III,  the  three  quanti¬ 
zation/fusion  schemes  are  analyzed  and  optimally  designed  for  the  case  of  weak-signal  detec- 
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ion  and  dependence  across  time  and  sensors  under  symmetric  conditions.  The  same  quantiza¬ 
tion/fusion  schemes  are  analyzed  and  optimally  designed  in  Section  IV  for  the  case  of  general- 
signal  discrimination  and  similar  models  of  dependence  across  time  and  sensors.  In  Section  V, 
numerical  results  based  on  simulation  are  presented  for  the  detection  of  weak  signals  in  Cauchy 
p-mixing  noise.  Finally,  in  Section  VI,  conclusions  are  drawn. 

II.  PRELIMINARIES 

II. 1  Models  of  Dependent  Observations 

As  mentioned  in  Section  I,  the  model  of  dependence  is  one  of  stationary  m-dependent,  <j>- 
mixing,  or  p-mixing  sequences.  These  models  are  described  in  detail  in  the  tutorial  of  [9].  Here 
we  review  briefly  two  of  these  models  of  dependence,  which  are  the  most  pertinent  for  the 
purposes  of  this  paper. 

The  simplest  model  of  dependence  assumes  that,  under  both  hypotheses,  the  observations 
are  stationary  and  m-dependent,  meaning  that  the  stationary  data  Xk  and  Xi  are  dependent 
with  known  joint  pdf,  for  \k  -  l\  <  m,-,  and  independent,  for  \k  -  l\  >  m,-,  under  hypothesis  Hi 
(see  [8]). 

For  each  positive  integer  n,  let  A  be  an  event  from  Xf  (which  is  the  a-algebra  generated 
by  the  random  variables  (Xl7  X2,  •  •  • ,  Xk})  and  B  an  event  from  X^_n  (which  is  the  cr-algebra 
generated  by  the  random  variables  {Xfc+n,  X&+rt+ 1,  •  •  •})■  Then,  if 

covi{X,Y)  <Pi,n  •  (3) 

for  all  real  random  variables  which  are  measurable  with  respect  to  A  and  R,  respectively,  where 
pi}Tl  is  a  sequence  of  real  numbers  with  p,in  — >■  0,  as  n  — ►  00,  then  the  sequence  of  observations 
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{XUX2,  •  ■  •}  is  termed  p-mixing.  Notice  that  (3)  implies  the  weaker  but  more  intuitive  result 


COD;{X(;)X[--(-n}  Pi,n •  (4) 

This  represents  a  good  model  for  a  time  series  of  data  that  are  asymptotically  uncorrelated; 
since  this  model  requires  only  asymptotic  uncorrelatedness  of  the  data,  it  is  the  most  general 
one  for  our  purposes  and  the  numerical  results  of  Section  V  will  be  dedicated  exclusively  to 
this  model.  The  tutorial  of  [8]  has  detailed  definitions  of  the  ^-mixing  and  a-mixing  (also 
termed  strong  mixing)  models  of  dependence,  which  characterize  sequences  that  are  respectively 
asymptotically  conditionally  independent  and  asymptotically  independent. 

II. 2  Asymptotic  Distribution  of  Test  Statistics 

In  general,  the  true  distribution  of  the  sensor  decision  statistics  Tn>k  and  Tn>*  ( k  =  1,2,---,  JiT) 
of  (1)  and  (2)  is  difficult  to  obtain.  However,  for  large  n,  one  can  employ  the  central  'limit  theo¬ 
rem  for  the  aforementioned  mixing  processes  (see  [9]).  Specifically,  assuming  that  the  statistics 
of  the  sensor  observations  are  identical  and  that  the  pairwise  joint  statistics  of  any  two  sensors 
are  identical  (symmetric  conditions),  we  define,  under  hypothesis  ( i  =  0, 1), 

Hi(g)  =  Ei[Tn>k]l  k  =  1,2,  — ,  iT  (5) 

m, 

aj(g)  =  vari[g(x[k])  ]  +  2  covt[g(x[k)),g{Xf^)}  (6) 

j= 1 

where  uar,[-]  and  cou,[-j  are  the  variance  and  the  covariance  operators,  respectively,  and 

Ei[(Tn,k  —  pi)  '  {Tn,l  ~  Pi)]  (y) 

where  the  numerator  of  (7)  is  equal  to  ^[covi{g(X^),g(xl^)}  +  2^Jli1  covi{g(X^),g(X^1)}] 
( k ,  l  —  1, 2,  -,  K );  m,-  is  the  range  of  dependence  under  tl\k\  for  the  m-dependent  observations  of 
the  £-th  sensor;  and  mt-  the  corresponding  parameter  for  the  cross-dependence  of  the  observation 
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sequences  between  any  pair  (k,l)  of  sensors.  For  mixing-type  observations,  we  take  m,-  — »  oo 
and  rhi  — *  oo.  Clearly,  because  of  the  stationarity,  under  hypothesis  Pi(g)  depends  on 

the  univariate  pdf  of  the  observation  sequence  {X^}”=1  (same  for  all  k  =  1,2,  ■  •■,/!')  denoted 
by  /i(-);  &f(g)  depends  on  /,•  and  the  bivariate  pdfs  of  (xjfc\ xj*\),  for  j  =  1,2,***,  denoted 
by  •))  and  pi{g)  depends  on  /,  and  the  bivariate  pdfs  of  (X-j^,  xj^),  for  j  =  0, 1,  2,  •  •  ■, 

denoted  by  /,^(-,  •)  [same  for  all  pairs  (fc, /)]. 

According  to  the  central  limit  theorem  for  mixing  processes,  under  ( i  =  0, 1)  and 

suitable  conditions  (see  [8]-[9]),  if  erf  converges  (which  is  trivially  satisfied  for  m-dependent 
processes  but  needs  to  be  assumed  for  mixing-type  processes)  and  erf  >  0,  (Tn< *  —  Pi)  /  (-j^erj) 
is  asymptotically  Gaussian  distributed  with  the  standard  .X(0, 1)  pdf.  The  conditions  for  the 
validity  of  the  central  limit  theorem  for  each  individual  type  of  mixing  processes  are  described 
in  [9]  and  are  assumed  to  be  satisfied  in  this  paper.  For  example,  for  p-mixing  processes  (for 
which  the  numerical  results  in  this  paper  are  generated),  besides  the  convergence  of  the  infinite 
series  above  and  the  strict  positivity  of  the  variance,  it  is  also  required  that  the  series  Pi, 2n 

and  Pi, 2"  converge,  where  pi<n  denotes  the  sequence  of  p-mixing  parameters  [involved  in 

(4)]  for  the  observation  sequence  of  sensor  k  (for  any  Ar  =  1,2,--  -,K),  under  hypothesis  Hjk\ 
and  pi<n  denotes  the  p-mixing  parameter  for  the  jointly  mixing  observation  sequences  {xj^}^ 
and  of  any  pair  of  sensors  (&,/). 

Henceforth  we  suppose  that,  under  hypothesis  H jk^  ( i  =  0, 1),  Tn tk  of  sensor  k  is  asymp¬ 
totically  Gaussian  distributed  with  mean  Pi(g)  and  variance  crf(g)/n;  moreover,  that  any  pair 
(Tntk,Tnti)  of  sensor  decision  statistics  is  asymptotically  jointly  Gaussian  distributed  with  the 
correlation  coefficient  p,(p).  In  general  —1  <  pi(g)  <  1;  however,  in  Sections  III-V  below  and 
in  the  analysis  and  simulation  for  the  third  scheme  displayed  by  Fig.  C.3,  we  assume  that 
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1  >  Pi  >  0  (a  model  for  many  practical  situations)  to  derive  useful  design  criteria.  We  also 
assume  that  Ho  <  Hi-  Moreover,  for  the  scheme  of  Fig.  C.3  we  assume  that  the  threshold  of  the 
sensors  r/s  satisfies  the  consistency  condition  po  <  Vs  5:  Hu  under  which  every  error  probability 
of  each  sensors  approaches  to  zero,  as  the  sample  size  increases,  according  to  the  mean  ergodic 
theorem  (see  [12]). 

Define  the  vector  of  the  decision  statistics  of  the  K  sensors  as 


Cn,K  —  pn,l  Tn, 2  '  '  ‘Tn,K]T • 

Then  the  mean  vector  of  £n  K  under  hypothesis  Hi  ( i  =  0, 1)  is 

bi  —  Ei[£nj(]  —  [fii  •  •  */it] 


(8) 


(9) 


and  the  corresponding  (K  by  K )  covariance  matrix 

EiUn,K  ~  bi)T($n,K  -  bi)}  =  -Si  (10) 

n 

where 

1  Pi  Pi  pi 

Pi  1  ‘  '  -  Pi  Pi 

Pi  Pi  *  *  *  1  Pi 

Pi  Pi  Pi  1 

In  (11)  we  have  suppressed  the  dependence  of  Hit  °f>  and  Pi  on  the  common  (for  all  sen¬ 
sors)  nonlinearity  g.  In  the  sequel,  since  we  are  interested  in  a  large  common  sample  size  n, 
[TniiTn>2  •  •  •  Tn>K]  is  assumed  to  be  a  Gaussian  random  vector  with  mean  vector  bi  and  covariance 
matrix  ~S under  hypothesis  Hi  ( i  =  0, 1). 
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II. 3  Asymptotic  Rates  for  Gaussian  Statistics 

To  characterize  the  asymptotic  rates  of  decrease  of  the  error  probabilities  for  Gaussian  statis¬ 
tics  as  the  sample  size  n  increases,  we  apply  the  large  deviations  principle  given  in  [15].  We 
consider  the  d-dimensional  Gaussian  random  vector  Y  —  [Yi  Yi  •  •  •  Yd]T  where  each  of  the 
Y\ ,  Y^i  •  •  •  is  generated  as  in  (1)  for  large  n  via  a  Central  Limit  Theorem,  and  define  the  vectors 
sT  =  [si  S2  •  •  •  3d]  and  z  —  [z\  z<i  •  -  -  Zi]T .  Under  Hi  ( i  =  0, 1),  the  scalar  functions 
relevant  to  the  application  of  the  large  deviations  principle  to  this  case  are  (see  [15]) 

c,-(s)  =  lim  —  In  Ei{ex])(nsTY)}  —  sT  ESY]  -f — s^covifYls  (12) 

n-+oo  ji  2 

and 

It{z)  =  sup  {sTz  -  a(s)}  =  hz  -  Ei[Y})T{cmi[Y} }-\z  -  Ei[Y]),  i  =  0, 1  (13) 

seRrf  ^ 

where  ^cov{\Y]  is  the  covariance  matrix  of  Y,  ct(s)  are  closed  convex  functions,  and  /,■  are  termed 
the  Legendre- Fenchel  transforms  of  ct(s)  (see  [15]).  Next,  we  define  the  entropy  functions  on 
any  set  G  €  Rd  as 

Ii(G)  =  inf {/.(z)  :  z  G  G}  (14) 


and  the  induced  probabilities 


Pi(G )  =  Pvi{Y  :YeG} 


(15) 


under  H{,  for  i  =  0, 1.  Then,  according  to  Hypothesis  II.  1  and  Theorem  II. 2  of  [15]  and  for  any 
set  G  G  Rd  ,  the  exponential  rates  of  the  probabilities  P,(G )  are  characterized  by  the  formula 

-lnPs(G)->  /;((?),  *  =  0,1.  (16) 

n 

as  n  — *  oo.  In  Sections  III  and  IV,  (16)  is  applied  to  derive  closed-forms  of  the  exponential  rates 
of  the  error  probabilities  of  the  fusion  center. 
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III.  DETECTION  OF  WEAK  SIGNALS 


We  consider  the  following  binary  hypotheses  testing  model  for  the  detection  of  a  weak  signal 
in  additive  stationary  dependent  noise 

H(0k)  :  =  NM 

H[k}  :  =  9  +  Ndk\  i  =  1,2,  k  =  1,2,  ...,K  (17) 

where  9  — >  0  with  9  >  0  is  the  nonrandom  weak  signal  and  are  stationary  noise 

sequences  of  the  m-dependent,  ^-mixing,  or  p-mixing  type.  Under  the  symmetric  conditions 
discussed  in  Section  I,  the  univariate  and  bivariate  densities  of  are  identical  for  different 
sensors  and  are  denoted  by  /(•)  and  /(■?)(•,  •)  (j  —  1,2,  for  the  observations  and 

(N-k\  respectively;  the  cross-bivariate  densities  are  also  identical  for  any  pairs  of  sensors 

(k,  l )  and  are  denoted  by  /^(-,  ■)  ( j  =  0, 1,  •  •  • ,  fh)  for  the  observations  (N-k\  N^). 

In  this  weak  signal  detection  problem,  we  adopt  the  notation  pg  —  Pi,  <7$  =  of,  and  pg  =  p\ 
to  express  the  functional  dependence  on  9  and  assume  the  following  regularity  conditions: 

(a)  jjg[ fff(x)f(x  ~  e)dx\  =  f  mi9(x)f(x  ~  e)\dx 

(b)  £i^£l|te0  >  o 

(c)  tfis)  ->  o&g) 

(d)  pe(g)  -*  Po(g) 

as  9  — >  0.  We  use  cr0(g)  and  pa{g)  to  represent  the  (normalized)  variance  and  correlation 
coefficient  of  the  sensor  decision  statistics  under  either  hypothesis  in  this  section. 

III.l  Fusion  of  Unquantized  Test  Statistics 

We  here  consider  the  scheme  described  by  Fig.  C.l.  For  jointly  Gaussian  distributed  Tn<k 
(k  =  1, 2,  •  •  • ,  K ),  the  (normalized)  log-likelihood  ratio  function  for  the  above  weak  signal  detec- 
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tion  problem  becomes 


-In  Ln 
n 


_L  ,  fe{Tn,i,Tnt2,  •  •  -,Tra,j<-) 

n  n/o(rn>1,rn>2,-.-,rn,K) 


5«„jr  -  -  to)  -  -  <>»f  V«„iK  -  M 


2  v>n,/\  w  — u  -vs  2' 

=  (6,  -  feof^n,*  +  ^W&O  - 
where  the  inverse  of  the  (normalized)  covariance  matrix  has  the  form 


(18) 

(19) 


^o1 


CTo(l  ~Po) 


1  0 
0  1 

0  0 
0  0 


-I - 


0  0 
0  0 

1  0 

1 

Po 


Po 


o'oC1  —  Po)(l  +  (K  -  1)po) 


1  1  •••  1  1 

1  1  •••  1  1 


1  1 
1  1 


1  1 
1 


(20) 


‘W-Po)  cro(l-Po)(l  +  (A'-l)po) 
in  which  I  is  the  K  by  K  identity  matrix  and  1  denotes  the  K  by  K  matrix  having  all  its 
elements  equal  to  1.  We  notice  that  the  above  ^Yn.Ln  is  Gaussian  distributed,  since  it  is  a  linear 
function  of  the  Gaussian  statistics  £ 

The  asymptotic  means  of  ln  Ln  under  the  two  hypotheses  take  the  forms 


<Po  =  Eq 


■  In  Lr 


n 


=  --(be  -  b0y  So  {be  -  b0) 


(21) 


and 


1 


ln  Lr 


n 


<p0  =  Eg 

and  its  asymptotic  variance  under  either  hypothesis  is 

1 
n 


=  |(6*  -  bo)T£o\bg  -  bo) 


(22) 


ri ,  i 

1 

ri ,  1 

var0 

-In  Ln 

=  — var0 

—  In  Ln 

n 

n 

n 

(bg-bofs^ibe-bo). 


(23) 
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For  the  threshold  of  the  fusion  center  r ?,  we  impose  the  consistency  condition  <po  <  p  < 
so  that  the  error  probability  of  the  fusion  center  Pk,p  converges  to  zero,  as  the  sensor  sample 
size  increases  to  infinity,  which  results  from  an  application  of  the  ergodic  mean  theorem.  The 
error  probability  of  the  fusion  center  is 

PK,n  =  pfoO  Ln  >  np)  +  (1  -  p)P<;(ln  Ln  <  nr])  -  pP0(  1)  +  (1  -  p)Pg( 0)  (24) 


where  we  used  the  notation  Po(l)  =  Po(ln  Ln  >  nrj )  and  P$(0)  =  P0(lnPn  <  nr]).  Let  Pmax  = 
max{Po(lnPn  >  np),  P$(\n  Ln  <  nr])}.  Applying  the  result  of  large  deviations  principle  given 
by  (16)  to  the  one-dimensional  case  ( d  =  1)  we  obtain 


—  In  PK  r) 
n 


=  —  —  In  P, 


__  llln(PP b(!)  (1-^(0)., 

n[  {  Pmnx  +  PmaT  )] 


-*  —  —  In  Pmax  =  min  (--lnP0  (-In Ln  >  p]  ,  --lnPe  f-lnXn  <  rj 
n  L  n  \n  J  n  \n  j 

=  min{/0({2  >  r]}),Ig({z  <  p})}  (25) 


where,  from  (13),  (14)  and  (21)-(23)  and  under  the  consistency  condition  (po  <  p  <  ipi,  we 
obtain 


Hiz  >  V})  = 


%u[z-E° 


1  1  \  2 

-In  L, 
n 


|nar0 


•  ln  Lr, 


n 


-l 


(V  ~  PoY 


2(be-b0)TZo1(be-bo) 


and 


(26) 


Hi2  <  *7»  =  inf  i  (  2  -  Eg 


IN  2 


-ln  Lt. 


{pe  -  v) 


n 

2 


var  o 


—  In  Ln 
n 


-l 


2{be-boyZvl(be-bQ)' 
Then  the  optimal  threshold  is  determined  as 


Popt  =  arg  max  (--lnP^l 
vo<ri<vi  L  n  ) 


(27) 
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Therefore 


arg  max  min{/0({z  >  77}), Ig({z  <  77})} 

yp  +  yi  =  0 

2 


(28) 


--In  PK,noPt  -*  min{/0({2  >  0}),/s({2:  <  0})} 
n 


2 (be  -  b0)TS-\be  -  60) 

=  l  ■  (bg-  bo)TZo  l(bg-b0) 

1  _  K[pe(g)  -  Mff) l2 

8  [1  +  ( K  -  i)p0(g)]^o(g) 

02  K[p'o(g)?  (2q) 

8  [1  +  (K  -  l)pQ{g)]al(g) 

where  we  used  (20)  for  Uq  1  and  the  regularity  condition  (b)  to  obtain  that  p,g(g)-p.0(g)  =  p'Q (g)0 
for  the  derivative  p'Q (g)  at  6  =  0  and  small  6  (0  — »  0). 

The  optimal  nonlinearity  g*K  of  a  A'-sensor  system  is  obtained  as 


g*K  =  arg  max 


[p'o(g)}2 

[1  +  (K  -  i)po(g)}°o{gy 


(30) 


The  maximization  in  (30)  is  similar  to  those  performed  in  [6]  and  the  optimal  nonlinearity 
satisfies  the  linear  integral  equation 


-  /'(x)  -  J  KK(x,y)g*K{y)dy  =  g*K(x)f(x) 


(31) 


where  the  integration  kernel  is 


m 

KK(x,y)  =  2^]  [f{j)(x,y)~  /(®)/(y)]  -  f(x)f(y) 
i=i 

+(K  -  1)  j  [/(°)(x,  y)  -  /(*)/(»)]  +  2  J2  [f{j)(x,  y)  -  f(x)f(y)} 


(32) 
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The  above  linear  integral  equation  is  a  necessary  condition  for  the  optimality  of  (]}< ,  to  this  we 
should  add  the  sufficient  condition 

Po{g)  >  ~  £  _i  (33) 

for  all  functions  g  satisfying  conditions  (a)-(d)  for  which  cr^g)  and  po(g)  converge  and  <7q (g)  >  0. 

We  can  actually  show  that  if  g*K  and  and  g^_x  are  the  optimal  nonlinearities  for  A'-sensor 
and  ( K  -  l)-sensor  systems,  respectively,  then 


SM  >  K\Po(9k-i)}2 

[1  +  (K  -  l)po{g*K)\<jl{g*K)  ~  [1  +  {K  -  l)po(9K-i)\<ro{.9K-i) 

>  (/y  -  l)bo(gft'-l)]2 _  /o4\ 

~  [1  +  (K  -  2)p0(g*K_x)]a$(g*K_1)  ^ 

where  the  first  inequality  results  from  the  optimality  of  g and  the  second  inequality  is  due  to 

the  fact  that  K/[l  +  ( K  —  l)p]  >  (K  -  1)/[1  +  ( K  -  2 )/>]  for  1  >  p.  The  inequality  in  (34)  implies 

that  increasing  the  number  of  sensors  increases  the  asymptotic  rate  of  the  error  probabilities 

of  the  fusion  center,  i.e.,  lim*-^  -£ln  PKlVopt  >  lim^oo  PK-i,Vopt  ,  and  thus,  since 

PKtfopt  S  PK—i,ri0pt  for  large  n,  it  improves  the  performance  of  the  multi-sensor  system. 

III.2  Fusion  of  Quantized  Observations 

Considering  quantizers  as  special  (discontinuous)  forms  of  nonlinearities  we  may  modify  the 
formulation  of  the  previous  section  to  derive  the  design  criterion  for  the  optimal  quantizer  used 
in  the  scheme  given  by  Fig.  C.2. 

Let  Q(X^)  (i  —  1,2,  be  the  output  of  the  quantizer  with  M  quantization  levels 

common  for  all  sensors.  Denote  by  t  —  its  breakpoints  and  by  u  —  [ux,U2,  •  •  • ,um ] 

its  quantization  levels.  Then,  from  (6)  and  (7), 


m  M  M 


rt\  nt'  11  1  rtr  rt\ 

°1{Q)  =  D(U')2  /  f(X)dx  +  2J2J2Y;UrU‘  /  /0)( 

/~1  J  tl  —  1  j=l  r= 1  1=1  J  tr  —  1  Jti_  1 


x, y)dxdy 
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-(2  m  +  1) 


' M  w, 

J2ul  f{x)dx 

7=1  Jtt-\ 


(35) 


and 


f>o(Q)rt(Q)  =  £o[g(X1(1))Q(X1(2))]+2^£0[Q(x{1))Q(xg)1)]  -  (2fh+l)(E0[Q(Xl1))})2 

3= 1 


M  M 


m  M  M 


1-tr  ftl  ft  r  ftl 

££uru,  /  /  f{0)(x,y)dxdy+2YJJ2Y.UrUl'  /  f^\x,y)dxdy 

r=l  Z=1  1  ^  1  j=}  r— ^  /— 1  1  ''tl  —  l 

M  m 

(2m  +  l)[Y^ui  f{x)dx}2.  (36) 

/=i 


Moreover,  the  partial  derivative  of  the  mean  takes  the  form 

£o(Q)  =  =  -/ Q{x)f\x)dx  =  f>[/(*/_i)  -  /(</)]-  (37) 

Define  the  vector 


A/  =  [-A/i,-A/2,-.-,-A/m]  (38) 


where  A/;  =  /(*/)  -  /(f/_i)  and  F  =  diag{f^  f(x)dx,  ■  ■  -,  //^  /(x)dx),  P  =  [Pr,/],  P  =  [Pr,;], 
P  =  [Pr,/],  and  P  =  [PTj/],  where 


pr,i~2Y^f  f  f^\x,y)dxdy 

(39) 

_  rtr  /*t|  _  ^  rtr  ft\ 

A,/ =  /  /  f^\x,y)dxdy+2^2  /  f{j\x,y)dxdy 

dtr-1  Jti^ i  j-_2  7<r_i  7<l_i 

(40) 

Prt/  =  (2m  -f  1)  •  f  f(x)dx  •  f  f{x)dx 

Jtr- 1  •£(_! 

(41) 

and 

Fri/  =  (2m  +  1)  •  f  f(x)dx  ■  I  f(x)dx 

Jtr—\  ''tl  —  1 

(42) 

for  r,  /  =  1,2,  •  • 

-,M.  Then  from  (30),  the  design  criterion  for  the  optimal  quantizer  (levels  and 

breakpoints)  is 

[£o(Q)32  _  (^/T)2 

[1  +  (F  -  l)^o(Q)]cr2(Q)  iz(F  +  P  +  P  -  P  -  PKr ' 
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If  we  assume  that  </,  for  l  =  0, 1,  •  ■  •,  M,  are  chosen  such  that  the  matrix  F+P+P-R—  R 
is  positive  definite,  then  for  fixed  breakpoints  we  can  obtain  the  optimal  quantization  levels  as 

uT  =  (F  +  P  +  P  -  R- R)~lAfT  (44) 

Substituting  for  these  optimal  quantization  levels  we  obtain  the  design  criterion  as  a  function 
of  the  breakpoints  t  in  the  form 

Af{F  +  P  +  P  -  R-  R)~lAfT  (45) 

This  expression  can  be  optimized  with  respect  to  t  to  obtain  the  optimal  breakpoints  by  means 
of  numerical  optimization  techniques  such  as  the  gradient  method. 

Similar  arguments  to  those  used  in  deriving  (34)  establish  that  the  performance  of  this 
scheme  can  be  improved  by  increasing  the  number  of  sensors. 

III. 3  Fusion  of  Binary  Sensor  Decisions 

Consider  the  scheme  given  by  Fig.  C.3,  in  which  the  k  sensor  ( k  =  1,2,  •  •  • ,  K)  performs 
a  threshold  test  based  on  the  test  statistic  £n  k  with  the  same  nonlinearity  g  and  threshold 
T]s  and  transmits  its  binary  decision  (0  or  1)  to  the  fusion  center,  where  a  likelihood  ratio 
test  is  carried  out  on  the  basis  of  the  sensor  decisions.  Let  dn>k  be  the  decision  of  sensor 
k  based  on  its  n  observations.  Then  the  log-likelihood  ratio  function  of  the  fusion  center  is 
lnXn  =  In  Pi(dnti,  dn}2,  •  •  • ,  dn^)l Po{dn^\,  dn^,  •  •  ■ ,  dn^K)  and  the  asymptotic  log- likelihood  ratio 
function  under  a  large  sample  size  is  characterized  by 

P\  (^71,1  5  ^71,2  7***7  dn,K  )  (d6) 

n 

>H\ 

The  fusion  center  executes  the  test  In  Ln  <h0  nrl ■  In  this  scheme,  the  threshold  of  the  fusion 
center  rj  is  selected  to  be  zero  since  the  case  of  interest  involves  equiprobable  a  priori  probabilities 
for  the  two  hypotheses. 


1  1 

In  Ln  —  In  P o(dHti ,  dn^,  •  •  • ,  — 

Tb  Tb 
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In  Appendix  A,  we  derive  by  means  of  the  large  deviations  principle  the  asymptotic  rate  of 
the  joint  error  probability  of  the  K  sensors,  when  there  are  i  Os  transmitted  from  them.  To 
compute  the  likelihood  ratio  test  of  the  fusion  center,  we  give  here  a  proposition,  which  is  proved 
in  Appendix  B. 

Proposition  1:  Under  the  above  framework,  and  for  the  problem  of  weak  signal  detection,  the 
likelihood  ratio  test  of  the  fusion  center  is  equivalent  to  a  majority  fusion  rule  if  and  only  if  the 
threshold  rj*  used  by  all  sensors  is 


Mfl  +  Mo 


(47) 


where  fig  and  fiQ  are  functionals  of  the  nonlinearity  gx-  In  this  case,  the  asymptotic  rate  of  the 
error  probability  of  the  fusion  center  becomes 


_  IIniV  ,  _  \K/2][ng(g)-fi0(g)?  _  P  \K 

n  8[l  +  (\K/2}-l)p0(g)]a%(g)  8  [1  + (\K/2\  -  l)po(g)]a$(g)' 

where  \Kj 2]  is  equal  to  (I(  -f  l)/2  if  K  is  odd  and  to  Kj 2  if  K  is  even. 

The  above  asymptotic  rate  is  used  as  the  design  criterion  for  deriving  the  optimal  nonlinearity 

gx  for  this  scheme.  In  particular  the  optimal  nonlinearity  is  obtained  as 


9k 


max. 


7T-7,  if  K  is  odd 


9  [2+(A'-l)po(3)Uo(2) 

1  max»  [2+(A;tS^b)’  if  K  is  ev™ 


(49) 


By  means  of  the  calculus  of  variations  method  described  in  [10]  (see  also  [6]-[7]),  we  obtain  the 
following  integral  equations  as  the  necessary  condition  for  the  optimization  problem  character¬ 
ized  by  {49) 


-  /'(z)  -  J  HK(x,y)g*K(y)dy  =  g*K(x)f(x) 


(50) 


with  the  integration  kernel 


y)  =  2  Ys[f{j){x,y)- f{x)f{y)\- f{x)f(y) 
j= i 
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(51) 


+  : 


K  -  1 


m 

f{0)(x,y)  -  f{x)f(y)]  +  2  £  [ f{j){x ,  y)  -  f{x)f(y) 


3= 1 


if  A"  is  odd,  or 


m 

HK(x,  y)  =  2  [/0)(x,  2/)  -  /(x)/(y)]  -  f(x)f(y) 

rh 

[f{0)(x,y)~f(x)f(y)}  +2J2  [f{j](x,y)  -  f(x)f(y) |  (52) 


i=i 
K  -  2 


+- 


j=i 


if  it  is  even.  The  sufficient  condition  for  achieving  the  maximum  in  (49)  is 


>  -rdn  (53) 

for  all  functions  g  satisfying  conditions  (a)-(d)  for  which  cr^(g)  and  po(g)  converge  and  cr^ig)  >  0. 

Suppose  that  g^-i  and  9k  denote  the  optimal  nonhnearities  of  (K  —  l)-sensor  and  A'-sensor 
systems  employing  the  scheme  of  Fig.  C.3,  respectively.  Using  arguments  similar  to  those  used 
in  the  proof  of  (34)  we  can  show  that  for  odd  K  (and  thus  even  K  —  1) 


lim 

n— +oo 


•—  In  Pk,t)1 
n 


> 

> 


(K  +  l)[M)? 

[2  +  (Ii  -  l)po(g*K)H{g*K) 

(K+l)[M-d? 

[2  +  (K  -  l)po(9K-i)]ao(9K-i) 


(A  -  l)KUfc-i)r 


[2  +  (K  -  Z)pn(qt’  ,  )1  aZ(gi 


—  =  lim 

J  n—+  oo 


(54) 


and  for  even  K  (and  thus  odd  K  —  1) 


lim 

n— kx> 


—  In  Pk,tj ; 
n  ’ 


KIM)? 


> 


(2  +  (A  -  2)pQ(g*K))ol(g*K) 

_ K[Pq(9k-i)? _ 

(2  +  (K  -  2)po(££-i))<7o(5a-i) 


=  lim 


n 


In  Pk -i,n 


(55) 


Thus,  under  a  large  sample  size  and  for  any  number  of  sensors  K  (odd  or  even),  the  error 
probability  of  the  fusion  center  decreases  as  the  number  of  sensors  increases. 


19 


IV.  DISCRIMINATION 

We  consider  the  problem  of  distributed  discrimination  from  general  (not  necessarily  sig¬ 
nal  in  additive  noise)  sensor  observations  characterized  by  stationary  m-dependent,  mixing, 
or  p-mixing  processes.  This  discrimination  problem  can  be  modeled  by  the  following  binary 
hypotheses  testing  problem 

4k)  ■■  x,<‘>  -[/»('), 

<’  :  X,  /P(-,  •)],  l=l,---,»;*  =  l,2,  ■■■,!(  (56) 


where  /,•  (i  =  0, 1)  are  the  univariate  pdfs  of  the  sensor  observation  processes  under  Hi  (identical 
for  all  sensors),  are  the  bivariate  pdfs  of  (xjk\Xjkj)  (also  identical  for  all  k),  and  fj^ 
(i  =  0, 1)  are  the  joint  pdfs  of  (xfT\  xfkj)  (also  identical  for  for  all  pairs  (r,  k)  of  sensors  with 
r  ^  k ).  Clearly,  the  above  multi-sensor  testing  hypothesis  problem  describes  several  situations 
that  are  not  characterized  by  signals  in  additive  noise  and  thus  is  a  suitable  model  for  target 
discrimination  problems. 

For  a  large  common  sample  size  n,  the  statistics  ( Tnji,Tn •  •  •  ,TUjk)  obtained  via  (1)  and 
(2)  are  jointly  asymptotic  Gaussian  distributed  when  conditioned  on  FT,  ( i  =  0, 1),  as  in  the 
previous  section. 

IV. 1  Fusion  of  Unquantized  Test  Statistics 

For  the  scheme  depicted  in  Fig.  C.l,  and  for  jointly  Gaussian  distributed  Tn tk  ( k  — 
1, 2,  •  •  • ,  K),  the  log-likelihood  ratio  function  of  the  fusion  center  takes  the  form 


—  In  Lr 
n 


2.  Jn  fl(Tn,l,Tn,2,  •  •  -,Tn,K) 

n  /o(rn,i,Tn,2,---,Tn>iy) 


7  In  +  kt«,K  -  to  -  W  -  -  i>i)rVr'(f„,JT  -  w 


(57) 
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where  ^27,-  denotes  the  covariance  matrix  of  £n<K  and  was  defined  in  (10)-(11)  for  i  ~  0, 1.  Its 
inverse  is  given  by 


E7 1  = 


-I- 


Pi 


ct,2(!  -  Pi)  aj{l  -  Pi)!1  +  (K  ~  l)pi) 


(58) 


where  I  and  1  were  defined  in  (20). 
The  mean  of  —  In  Ln  under  Hq  is 


E0 


■  In  Lr 


n 


l ln  jf~ +  \EoUn,K  -  bo)TZo 1  (Zn,K  -  bo)]  -  \Eo[(tn,K  -  hi  )TZi\tn,K  ~  *l)3 

(59) 


where 


2Eoi(£n,K  ~  bo)TEQl(An,K  ~  &o)]  -  2~ 


(60) 


and 


\mu,K  -  i>i)Tvr'({.,K  -  fri)],.= 

1  —  r  /  *.  -  \T  1  /  »  \T  .  1  , 


=  §£<>[(*», *  -  b0ysz\Cnjc  -  6o)]  +  f  (6i  -  -  M 

J_  [  gpg(l  +  (^-2)pi) _ pqpi<t$K(K  -  1)  1  1,,  \Ty-l(h  _h  \ 

2n  [2of (1  —  pi)(l  +  (K  -  l)pi)  2al(l  -  Pl)(l  +  (K  -  l)Pl)\  +  2(&1  °}  1 


(61) 


Thus  the  asymptotic  mean  of  -  ln  Ln  under  Ho  as  n  — * ►  oo  becomes 


<po  =  lim  Eq 


-In  Ln 
n 


=  -i(61-60)T^r1(&i-6o)  =  - 


E[Pi(g)  -  Po{g)]2 

2[i  +  ( K  -  l )Pi(g)](Ti(g) 


(62) 


Similarly,  we  can  obtain  the  asymptotic  mean  of  ^  ln  Ln  under  H\  as 
cpi  =  lim  Ei 


-In  Ln 
n 


!/,  ,  \T  n— i  /i  ,  \  K\Pi(g)  -  Po{g)]2 

=  -(&,  -  6„)  H0  (6,  -  to)  -  2[1  +  {K  _ 


(63) 


Again  we  assume  the  consistency  condition  <po  <  1  <  y7!  lor  tlle  threshold  of  the  fusion  center. 
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In  the  discrimination  case  the  asymptotic  rate  of  the  error  probabilities  of  the  fusion  center 
can  not  be  obtained  in  closed  form  in  the  way  done  for  the  detection  of  weak  signals  (Section 
III).  Instead,  we  use  the  lower  bounds  on  the  asymptotic  rate  obtained  in  Section  II  of  [7]  (see 
Lemma  1,  Theorem  2,  and  Appendix  A),  where  the  large  deviations  principle  was  applied  to 
yield 

j~ ^lnP0  Q-lnin  >  >  (77-  ip0)s  (64) 


and 

^lirn^  In  Pi  ^  In  Ln  <  rj  j  j  >  ( ipx  -  g)s  (65) 

for  a  small  constant  s  >  0.  Therefore,  we  use  min{(j7  —  c/?o)5,  ('P’l  —  v)s}  as  a  lower  bound  on 
the  asymptotic  rate.  We  require  that  the  threshold  of  the  fusion  center  77  maximizes  the  above 
lower  bound;  this  leads  to  an  optimal  threshold  rj*  —  (cpa  +  <^i)/2  and  a  maximum  value  of  the 
lower  bound  to  the  asymptotic  rate  s(g>i  -  Po)/2.  Therefore,  a  suitable  design  criterion  for  the 
discrimination  case  is 


J(,n  \  -  yi  -yo  _  fffci(g)  -Mo(ff)]2  ,  K\ni jg)  -  Ho (g)]2  .  . 

2  4[1  +  (K  -  1  )pi(g)\cr'Kg)  4[1  +  {K  -  l)po{g)vo(gY 

The  optimal  nonlinearity  gx  which  maximizes  this  design  criterion  satisfies  a  nonlinear  integral 

equation  (a  necessary  condition)  but  we  can  not  derive  sufficient  conditions  that  guarantee  that 

the  solutions  to  this  equation  achieve  the  maximum.  Instead  of  pursuing  this  path,  we  consider 

the  following  design  criterion 


_ K\Mg)  -  Po(g)}2 _ 

[1  +  (K  -  i)p0(g)K(tf)  +  [1  +  (K  -  l)pYg)]°l(g) 


=  Ji<(g)  <  J(<po,<pi). 


(67) 


which  is  lower  bound  on  (66)  as  attested  by  the  inequality  (for  all  x,y  >  0) 


J_  J_  _  x  +  y  >  x  +  y  _  1 

4x  Ay  Axy  ~  (x  +  y)2  x  +  y 
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This  lower  bound  becomes  tight  as  po  —+  p\  and  <Tq  — >  a\  (e.g.,  in  the  case  of  detection  of  a 
weak  signal).  Thus  the  optimal  nonlinearity  is  determined  as 


*  j  /  \  _  [^1(9 k)  ^q(Sk)} _ 

9K  -  m9KX  Ki9h  )  ~  “  [1  +  (K  -  1)po(9k)K(9k)  +  [1  +  (K  -  l)pi(gK)]^(9K) ' 

The  above  maximization  leads  to  the  necessary  condition  characterized  by  the  linear  integral 


equation 

[/i(z)  -  /o(*)]/[/i(*)  +  /o(*)]  -  J  Kk(x,  y)g*K(y)dy  =  g*K{x)  (69) 


where  the  integration  kernel  takes  the  form 


Kk(x,v) 


m\  •  1  7711  r  \ 

2E  /i(*)/i(»)  +2(tf  -  f)E  [/?(*»»)  -  Mx)My), 

j- 1  i=1 

m°  i  "l°  r  1  "1 

+2g  /(J)(x,y)-  /„(*)/„(»)  +  2(/v  -  1)£  [/^(x.y)  -  /o(*)/o(») 

i=x  j=i 

+(/<■  -  1)  [/{0)(X,»)  -  /i(*)/i(y)]  +  (if  -  1)  [/«S0)(*,»)  -  fo(x)My) 

—fi(x)fi(y)  -  fo(x)f0{y)}/{fi(x)  +  f0(x)}.  (70) 


Sufficient  conditions  for  the  maximization  of  J  by  the  nonlinearity  g*K  are 

Pi(g)  >  -  K  jy  *  =  M  (71) 

for  all  functions  g  for  which  trf(g)  and  pi(g)  converge  and  af(g )  >  0  (i  =  0, 1). 

Following  arguments  similar  to  the  ones  used  for  the  proof  of  (54)-(55)  we  can  show  that 

Wk)  >  Jk-i(9*k-i)  (72) 

which  implies  that  on  the  basis  of  the  lower  bound  on  the  asymptotic  rate  for  the  error  prob¬ 
abilities  of  the  fusion  center,  the  performance  of  the  multi-sensor  system  improves  (the  error 
probability  decreases)  as  as  the  number  of  sensors  increases. 
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IV. 2  Fusion  of  Quantized  Observations 

We  consider  the  scheme  displayed  by  Fig.  C.2  for  the  general  signal  discrimination  problem. 
Let  Q(xfk))  (/  =  l,2,...,n),  t  =  [t0  h  •••  tM]  and  u  =  [m  u2  ■■■  uM]  be  defined  as  in 
Subsection  III. 2.  Under  Hi  (i  =  0, 1),  we  have  equations  similar  to  the  ones  given  by  (35)-(37) 
namely 


M  mi  M  M  ,ir  ftl 

f(Q )  =  J2(u‘)2  /  fi(x)dx  +  /  /  fi 

1=1  ■'*«-!  j=l  r=l  1=1  J«r-1  “'<1-1 


P\x,  y)dxdy 


-(2m  -fi  1) 


Vu,  /  fi(x)dx 
.1=1  J*i-i 


(73) 


771  .  . 

Pi(Q)<TKQ)  =  ^•[0(Xp))Q(X1(2))]+2£  f?,-[g(X1(1))g(xjl)1)]  -  (2m;  +  l)(Ft[Q(x|1))])2 

i=i 


MM  rt  rti  "H  m  lvl  rtr  ru  ~< 

=  (  /  ff\x,y)dxdy+2Y^^Y^uTul-  I  f\ 

r=l  /=1  •'P-i  j= 1  r= 1  2=1 

M  rtt 

-(2m,- +  l)[]Tu;  /  fi(x)dx )2  (74) 

2=1 


771,  A/  M 


y’(x,y)dxdy 


and 


/*  rti 

P-i(Q)  =  -  J  Q(x)fi(x)dx  =  Yju‘  Jt  Mx)d 


_  (75) 

2=1  Jt‘~1 

For  r,l  =  1, 2,  •  •  • ,  M  and  under  (i  =  0, 1),  define  the  vector  /,  =  [/i,,-  f2,i  •  •  •  /a/,»] »  where 
/(,,•  =  fi(x)dx,  and  the  matrices  F,  =  diag{f^  fi(x)dx,  •  ■  fi(x)dx},  Pi  =  [Pr,(,«]> 


Pi  —  [TV,/,;]}  —  [72r,2,t])  and  R%  —  [-Kr,2,i]  where 


x  rtr  rn 

Pr,l,i  —  2  /  /  fjj)(x,  y)dxdy 

j—\  ^r—1  J  tl— 1 

Rr,l,i  =  (2m;  +  1)  /  /i(x)dx  •  [  fi{x)dx 
Jtr- 1  4q_1 


Pr,l,i=  fr  r  fl°\x,y)dxdy  +  2f^  f  fjJ\x,y)dxdy 

Jtr_i  4t,_ j  J=1  -hr_i  dq.j 


(76) 

(77) 

(78) 
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and 


ftr  ftl 

Rr,l,i  =  (2m,-  +  1)  •  /  fi(x)dx  ■  fi{x)dx. 

Jtr-l 

For  the  quantizer  Q ,  the  objective  function  given  by  (67)  becomes 

j  (Q)  _ _ Wi  ~  /of]2 _ 

A  «Ei=o(^i  +  Pi  +  Pi  -  Ri  -  iU)]nT' 


(79) 


(80) 


Assuming  that  t  are  such  that  the  matrix  J2i=o(Ri  +  Ri  +  Pi  —  Ri  -  Ri)  is  positive  definite, 
we  again  fix  the  breakpoints  first  and  derive  the  optimal  quantization  levels  for  any  sensor  as 


u 


T 


£( Fi  +  Pi  +  Pi-  Ri  -  hi) 


(f  1  -  /of 


(81) 


Li=0 


Then,  upon  substitution  for  the  above  optimal  levels  into  Jk-,  we  obtain  the  performance  measure 
as  a  function  of  the  breakpoints  t  as  follows 


MQ)  =  (/ 1  -  fo) 


^(Fi  +  Pi  +  Pi-Ri-Ri) 


(f  1  -  /of- 


(82) 


Lt=o 


The  maximization  of  this  expression  with  respect  to  the  breakpoints  can  be  accomplished  via 
numerical  optimization  techniques. 

It  not  difficult  to  show  that,  if  Q*K  denotes  the  optimal  quantizer  (breakpoints  and  quanti¬ 
zation  levels)  for  the  K- sensor  system,  then  Jk(Qk)  —  Jk-i(Qk-i)  an<^  as  numl>er  °f 
sensors  increases  the  performance  of  the  multi-sensor  system  improves. 

IV. 3  Fusion  of  Binary  Sensor  Decisions 

In  this  case  of  general  signal  discrimination  via  the  scheme  illustrated  in  Fig.  C.3,  the 
majority  vote  fusion  rule  discussed  in  Subsection  III. 3  is  employed.  Following  arguments  similar 
to  the  ones  in  Subsection  III.3  we  can  derive  the  asymptotic  rate  of  the  error  probability  of  the 
fusion  center  as  [cf.  to  (A. 21)  of  Appendix  B] 


1  r  i 

—  In  Pktj,  — »■  min<— — InPol  (K  ~  *)  “0”s  are  transmitted  }, 
n  In 
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- In  {  i  “0”s  are  transmitted  };  for  i  =  \K/2] ,  \I( /2]  +  1,  •  •  • ,  K 

n 


\K/2](rj3- no)2 


\K/2\(fii  ~  Vs)2 


[1  +  (\K/2]  -  l)p0]oV{l  +  tttf/21  -  l)piW 


where  the  optimal  threshold  employed  by  all  sensors  is  determined  as 


r?„  =  max  <  —  In  Pk 

Mo<f)«<M0  l  n 


=  max  mm 


\K/2](Vs  ~  Po)2 


\K/2](hi  -  r]s)2 


<•>.£*  1  [1  +  (\K/2  \  -  l)poH  ’  [1  +  {\KI2]  -  l)pi )a\ 


3p<7l  +  Hi' 

3QO-0  +  \fi 


K  2  -  l)picr0 


for  any  K .  Upon  substituting  of  this  threshold  into  (83)  we  obtain  the  asymptotic  rate  of  the 


error  probability  of  the  fusion  center  as 


- In  Pk,v* 

n  '  “ 


[Pi(ff)-Po(ff)]2 
Jx/2]  -  l)po{g)(?o(g)  +  \/l  +  ( 


K/2\  -  l)pi{g)(Ti{g) 


Maximizing  the  above  asymptotic  rate  directly  (via  calculus  of  variations  techniques)  results  in 
a  nonlinear  integral  equation  that  the  optimal  nonlinearity  must  satisfy  and  in  very  complex 
sufficient  conditions.  Therefore,  in  order  to  avoid  these  complications  we  consider  the  following 
lower  bound  on  the  asymptotic  rate  of  (85) 

1  _ [Pl(g)  ~  Po(ff)]2 _  f8fix 

2  [1  +  (17*721  -  l)p0(g)K2(g)  +  [1  +  (\K/2]  -  l)pi(gW(ff)' 

[obtained  from  an  application  of  the  inequality  >  2(j2+^)]‘  This  l°wer  bound  becomes 

tight  as  <Tq  — ►  c\  and  po  — * ►  pi;  this  corresponds  to  the  weak-signal  detection  case.  Finally,  the 
optimal  nonlinearity  is  obtained  as 

may  _ [Mi(.g)-Mo(ff)]2 _ _  i c  ndd 

g*  _  9  [2+(A'-l)po(3)K(3)+[2+(A-_l)«(3)]a^  0(1(1  ^ 

maX  - [Ml  (ff )~M0  (p)] -  If  flf  Jg  pypri 

3  [2  +  (A-2)p0(5)]^(3)+[2  +  (A'-2)p:(3)]^>  even- 

The  above  maximization  leads  to  the  linear  integral  equation 

[fi(x)  -  /o(z)]/[/i(z)  +  /o(*)]  -  J  Hk(x,  y)g*K{y)dy  =  g*K(x)  (88) 
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where 


Hr :{x,y)  =  <  2X  [/}j)(a:»y)  ~  /i(*)/i(»)]  +  (K  ~  !)  I]  [/fj)(ar»  2/)  “  fi{x)fi(y) 

[  j=l  3= 1 

mo  mo 

+2  XI  [/oJ)(:E»  y)  -  /o(*)/o(y)]  +  (K  -  l)  X  [fo\xi  v)  -  Mx)fo(y) 


j= i  i=i 

[A<0,Oc-s)  -  AW/.W]  +  ^  [/?’(*,»)  -  fo(x)fo(y) 

-/i(*)/i(y)  -  /o(*)/o(y)}  /{/i(*)  +  /o(*)}- 


(89) 


if  If  is  odd,  and 


#*(*,»)  =  ^  2  X)  y)  -  /i(*)/i(»)]  +  (^  -  2)  x;  [/P^Ca:,  y)  - 

[  3=1  3=1 

mo  mo 

+2X  [fo\x^y)  -  /o(*)/o(y)]  +  (K  -  2)X  [fo\x’V)  -  fo(x)fo(y) 


+ 


3=1 

K  -  2 


J=1 


[/i<0|(*,  k)  -  AM/iW]  +  ^  [/ft*, »)  -  fo(x)fo(y) 


2  L*'  I  \  ■  2 

-7i(*)/i(y)  -  /o(*)/o(y)}  /{/i(*)  +  /o(*)}. 


(90) 


if  K  is  even.  The  sufficient  conditions  for  the  maximization  in  question  are 

pi(g)  >  — f ;for  * =  0,1  (91) 

for  all  functions  g  for  which  of  (5)  and  pi(g)  converge  and  af(g )  >  0  (i  =  0, 1). 

Finally,  following  arguments  similar  to  those  used  for  the  proof  of  (54)-(55)  we  can  show 
that 

lim  \--pK,r,t  \  >  lim  {--Pk-  1,7,5}  (92) 

n— >oo  n  '*  J  n— 00  In  J 

for  any  K  (odd  or  even),  where  P  denotes  the  upper  bound  on  the  error  probability  (lower  bound 
on  the  asymptotic  rate)  of  the  fusion  center  obtained  in  this  section.  Thus,  under  a  large  sample 
size,  the  upper  bound  on  the  error  probability  of  the  fusion  center  decreases  as  the  number  of 
sensors  increases. 
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V.  PERFORMANCE  EVALUATION 


To  establish  the  usefulness  of  the  data  fusion  schemes  derived  in  the  previous  sections  for 
signal  detection  problems,  we  evaluate  the  performance  of  the  three  schemes  via  computer 
simulation  and  compare  it  to  that  of  the  corresponding  schemes  which  neglect  dependence  in 
sensor  observations. 

The  simulation  results  presented  in  this  section  pertain  to  the  detection  of  a  weak  signal  in 
additive  Cauchy  p-mixing  noise. 

The  two  hypotheses  are  assumed  to  have  equal  a  priori  probabilities,  which  results  in  select¬ 
ing  p  =  0.5.  The  two  types  of  error  probabilities,  the  probabilities  of  missing  (Pi(0))  and  of  false 
alarm  (Po(l))  for  the  fusion  center,  are  used  as  the  performance  measure.  In  all  examples,  1000 
simulations  are  run  for  generating  all  results  in  this  section  and  receiver  operating  characteristics 
(ROCs)  are  provided  for  comparison.  To  obtain  good  performance  (10~2  order  of  error  probabil¬ 
ities),  5000  samples  are  collected  for  weak  signal  detection  (with  SNR=-72.5  dB,  as  seen  in  the 
following).  In  our  simulations,  the  magnitude  of  noise  (in  the  weak-signal  detection  formulation) 
is  forced  to  be  between  Xmin  and  Xmax.  In  this  way,  very  small  or  very  large  samples  (in  the 
tails  of  the  distributions)  caused  by  deficiencies  in  the  random-number  generators  are  discarded 
and  good  quality  simulated  data  are  fed  into  our  schemes.  The  appropriate  values  of  Xmin  and 
Xmax  are  derived  for  the  specific  noise  or  observation  pdfs  by  requiring  that  Pk,i{X  <  Xmin}  <  e 
and  Pk,i{X  >  Xmax}  <  e,  for  i  =  0,1  and  k  =  1, 2,  •  •  • ,  K ,  where  e  =  10~6. 

Without  loss  of  generality,  the  magnitude  of  the  weak  signal  6  is  taken  to  be  0.2,  which 
implies  a  signal  power  of  —20 dB.  The  univariate  density  of  the  Cauchy  noise  is  given  by 


fk(xW)  = 


-,  fc=i, 2, ■■■,!( 


7r(  1  +  (zW)2) ' 

Although  the  second-order  joint  density  of  Cauchy  noise  is  difficult  to  derive  directly,  it 
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can  be  evaluated  from  the  second-order  joint  density  of  a  Gaussian  process  by  a  nonlinear 
transformation.  Let 

e*p[ 

be  the  univariate  density  of  the  underlying  Gaussian  process,  Then  the  aforementioned  nonlinear 
transformation  has  the  form  (see  [11]) 

z(y)  =  tan[7r  •  erf(y/V 2)/2]. 


The  range  of  the  Gaussian  random  variable  x  is  taken  to  be  [—5,  5]  and  the  pair  Xmin  and  Xmax 
mentioned  above  is  obtained  from  z(— 5)  and  z( 5).  We  can  compute  the  noise  power  for  the 
purpose  of  our  simulations  by  limiting  the  noise  in  the  range  [Xmtn,  Xmax ]  as  f Xmin  Z2  — 

ft5[z(x)]2 fo(x)dx ,  where  z(x)  was  defined  above.  From  this  noise  power  calculation,  we  obtain 
a  SNR  of  -72.5 dB. 

We  generate  the  underlying  Gaussian  process  for  the  Cauchy  noise  process  of  each  sensor 
by  the  following  autoregressive  model  with  correlation  coefficients  —  1  <  pG,k  <  1,  for  k  = 
1,2,  -“,K, 

N[k)  =  V}k) 

Nlk)  =  PG+N^+yfl-plV^-,  i>  1. 

In  the  above  recursion  formula,  V^k\  for  i  =  1,2,  •  •  •,  n,  are  sequences  of  i.i.d.  random  variables 
with  standard  Gaussian  (A/"(0, 1))  densities  and  are  generated  in  the  manner  described  by 

v}2)  =  pcv[1]  +  yjl  -  P2W\2) 

w(3)  _  Pc  T /" ( 1 )  I  P°  T/(2)  ,  \/l  "dc  —  Pc  ~~Pc  w(3) 

’■  1  +  Pc  *'  +  1  +  Pc  •'  +  1  + Pc 

vfk)  =  a\k)vt{1)  +  a\k)vt(2)  +  •  •  •  +  a[k)Vi{k~1)  +  b\k)wjk) 
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where 


_(*)  _  Pc 

1  1  +  (k  —  2  )pc 

■  x t (k-  2)pe  t1  +  2(t  -  »>* + (ti  - 5t + 5V-  -  - ~  ‘f  ~ 2)P 

is  another  i.i.d.  standard  Gaussian  (^V(0,1))  process,  for  each  k  (k  =  2, 3,  •  •  • ,  K),  and 
—  1  <  pq}C  <  1  is  the  correlation  coefficient  characterizing  the  dependence  across  sensors; 
and  W-^  are  mutually  independent.  Under  the  nonlinear  transformation  N =  z(N^), 
{iV^fc)}"_i,  for  each,  A:  is  a  p- mixing  Cauchy  noise  sequence. 

In  Example  2,  we  employ  the  16-level  quantizers  that  are  symmetric  with  respect  to  zero 
for  symmetric  Cauchy  noise.  Therefore,  in  the  following  tables  for  quantization  levels  and 
breakpoints,  only  the  half  of  positive  breakpoints  is  given. 

Example  1:  This  example  pertains  to  Scheme  1.  Fig.  1.1  gives  the  optimal  nonlinearities 
gopt  for  different  K  and  the  one  obtained  by  ignoring  dependence  across  time  and  sensors,  gad- 
Figs.  1.2  and  1.3  present  the  comparison  of  ROCs  for  K  =  6  and  K  =  3,  where  P0\  and  Pi0 
are  the  probabilities  of  false  alarm  and  miss,  respectively,  and  gias  is  the  optimal  nonlinearity 
obtained  by  ignoring  the  dependence  across  sensors.  Then  in  Fig.  1.4,  the  comparison  of  ROCs 
for  K  =  1,2,  3, 6  by  using  the  optimal  nonlinearity  is  given. 

Example  2:  This  example  pertains  to  Scheme  2.  Tables  1  and  2  give  the  optimal  16-level 
quantization  levels  and  breakpoints  for  optimal  quantizers  qopt  and  K  =  1,2, 3,  6.  Table  3  gives 
the  ones  for  the  optimal  nonlinearity  obtained  under  i.i.d.  observations.  In  Figs.  2.1  and  2.2, 
the  comparisons  of  ROCs  for  K  =  6  and  K  =  3  are  presented  for  schemes  using  qopi,  qias  (the 
optimal  nonlinearity  obtained  by  ignoring  the  dependence  across  sensors)  and  qua ■  Fig.  2.3 
presents  the  comparison  of  ROCs  for  K  =  1, 2, 3, 6  by  using  corresponding  qopt- 
Example  3:  This  example  pertains  to  Scheme  3.  Fig.  3.1  gives  the  optimal  nonlinearities  gopt 
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for  K  =  1,2,  3, 6  and  gm.  Figs.  3.2  and  3.3  present  the  comparison  of  ROCs  for  K  =  6  and 
K  =  3  by  using  gopt,  gias  and  gm ,  respectively.  Then,  Fig.  3.4  gives  the  comparison  of  ROCs 
for  K  =  1,2,  3,  6  by  using  corresponding  gopt. 

Finally,  in  Figs.  4.1  and  4.2,  the  comparisons  of  ROCs  for  K  —  6  and  K  =  3  are  given  for 
the  three  different  schemes. 

VI.  CONCLUSIONS 

We  have  designed  and  analyzed  the  performance  of  multi-sensor  fusion  and  quantization 
schemes  with  K  identical  sensors  for  the  detection  of  weak  signals  in  dependent  stationary 
noise  and  signal  discrimination  under  symmetric  conditions.  These  schemes  employ  memoryless 
nonlinearities  and  take  advantage  of  dependence  in  the  observations  across  time  and/or  sensors 
for  a  better  performance. 

The  dependence  of  the  sensor  observations  is  characterized  by  stationary  m-dependent,  4>- 
mixing,  or  p-mixing  sequences.  The  performance  is  measured  by  the  two  types  of  error  probabil¬ 
ities  of  the  fusion  center.  The  optimal  nonlinearities  and/or  quantizers  are  obtained  by  solving 
uncoupled  or  coupled  linear  integral  equations  that  involve  the  univariate  and  bivariaite  pdfs  of 
sensor  observations. 

As  seen  from  Figs.  1.4,  2.3  and  3.4,  performance  improves  as  the  number  of  sensors  K  in¬ 
creases.  As  expected,  Figs  4.1  and  4.2  show  that  fusing  the  unquantized  test  statistics  is  superior 
to  all  schemes.  Another  interesting  result  from  Figs.  4.1  and  4.2  is  that  Scheme  3  outperforms 
Scheme  2  in  the  context  of  ROCs.  Furthermore,  schemes  which  consider  dependence  across 
time  and  sensors  outperform  those  that  ignore  dependence  across  sensors  and  also  significantly 
outperform  those  that  ignore  dependence  across  time  and  sensors. 
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Appendix  A:  Asymptotic  Rates  of  Joint  Error  Probabilities  for  Scheme  3 

In  the  following,  we  use  the  large  deviations  principle  cited  in  Subsection  II.2  to  chciracterize 
the  asymptotic  rate  of  the  error  probabilities  of  the  fusion  center  for  the  scheme  displayed  by 
Fig.  C.3. 

Since  £  is  multi-dimensional  Gaussian  distributed,  the  corresponding  Iq{z )  given  by  (-J3) 
with  dimension  d  =  K  is 


To(z)  =  -  E0[t])Tcov0[Z]  *(z  -  £0[£]) 


-(2-60)  Z0  (2 -b0) 


K 


(1  +  (7F-1>o)E 


{zj-jx o)2 


^  crlil  -  po)(l  +  ( K  -  l)p0) 


K  K 

-*E  E 


J  =  1  <  -/V  -v  /.  ”/  j=ll=ltl^j 

K  KK 

(1  +  (K  -  l)po)  E  u)  -  P°  E  E  uiUl  I  =  -fo(u) 

3= 1  i=i  1=1, tyj 


.  a 


where  we  denote  the  normalized  Zj  by  Uj  =  ( Zj  -  /zq ) / { ctq \/(  1  -  />o)[l  +  (K 


(zj  -  Ho){zi  -  /i0) _ 

o(l  _  Po)(l  +  (A  -  l)Po) 
(A.l) 

-  1  )Po] }  r  for  j  = 


If  there  are  i  0  s  (or  K  —  i  1  s)  in  the  sensor  decision  vector  (dnri,dnt2,  ■  ■  • ,dn<K )  which  is 
transmitted  to  the  fusion  center,  then  the  asymptotic  rate  in  (40)  is 


—  —  In  Po(dn  1,  dn  2,  •  •  •,  dn  k)  =  —  —  In  Po{i  Os  are  transmitted} 
n  ’  ’  ’  n 

=  —  —  fo  Po(Tn,l  5:  Vsi  Tn,2  ^  T)si'  ‘  ‘  Tn,i  >  rjs,  -  ■  • ,  Fn./f  ^  7?s)  (A. 2) 


where  Tn^;  for  fc  =  1,2,  ■■■,!{,  are  Gaussian  distributed  with  identical  individual  means,  vari¬ 
ances,  and  pair-wise  correlation  coefficients.  Let 


A  =  {z  e  TLk  :  zx  <  rjs,  z2  <  rjs,-“,zi  <  rjs,zi+1  >%,•••, zK  >  r)s} 

=  {u£  RA  :  Ui  <  tjs,o,  u2  <  rjs,o,  <  rjs,o,  m,+1  >  t?s,0,  >  Vs,  0}  (A. 3) 
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where  r/Si0  =  ( r]s  —  Mo) / {°o\/0-  —  Po)[l  +  (77  -  l)/>o]}  is  the  normalized  threshold.  Then,  from 
the  large  deviations  principle  given  by  (10),  we  have 


In  Po(Tnti  ^  T}s,  'I'n,2  5s  J|s) '  "  )  Tn<{  5s  4?s,  ^n,i‘+l  ^  Ms>  '  '  '  >  ^ n , /\  >  Vs)  — 


n 


= - In  P0(£  £l)=  inf  70(z)  =  inf  70(-u) 

n  ze>t  txeA 


K  K  K 

=  +  -  P°Y1  5E 

i=i  i=i 


2  tteA 
1 


inf,  pi  +  (A’  -  £ 


2  tte.4 


Po 


A' 


1  2 


1  +  (77  -  j  -  l)po  ,  Ul 


+ 


1  +  (77  —  l)po 
1  +  (K  -  i  -  l)p0 


(l  +  (K-i-2)p0)  £ 


K 


U; 


j=i+ 1 


uiui 

j—i+ 1 


(A-4) 


Define  the  vector  u (*)  =  [u,-+i  Ui+2  ■•■uk]T,  which  belongs  to  R(a  !)  and  the  set  A;  = 
{(ui+i,ui+ 2,  •  •  • ,  uK)  e  R(a-“)  :  ui+l  >  rjtfi,  ui+2  >  Vs,o,  •■■,uk>  Vs, o}-  Apparently, 


inf  /0 (u)  >  inf  Iq\u{) 
ueA  y  '  ~  •u.e. 4,  u 


(A.5) 


where 


io\ui)  = 


1  +  (77  -  i)p0 


K  K  K 

(1  +  (77  -  i  -  2)p0)  E  E  5E  Uj  41/ 

j=t‘+l  i=i+l  l=i+l,l-^j 


.  (A. 6) 


2(1  +  (A  —  i  —  l)p0) 

We  notice  that  the  set  A,-  is  symmetric  with  respect  to  uj,  for  j  =  i  +  1,  i  +  2,  •  •  •,  77.  Thus  it  is 
easy  to  verify  that 


u*  =  [<+1  u*+2  ukY  =  arg  inf  4')(t*«) 

u-t  c-At 


(A.7) 


satisfies  u*+1  =  u*+2  =  •  •  •  =  u*K.  Therefore, 


inf  Iq\u{)  =  inf 


f  1  +  (77  -  l)po 
,e-4,  1 2(1  +  (A  -  i  -  l)p0) 


K  K  K 

(1  +  (K  -  i  -  2)po)  J2  uj  -  Po  EE  J2 

j—i+l  j=i+ 1  /=j+l,/#i 


=  —  inf 

2  «■+!  >17s,0 


(77  -  0(1  -  Po)(l  +  (A  -  l)po)] 
1  +  (7t  —  i  —  l)po 


b'+i 


UjUl 
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1  ( IC  -  Q(1  -  p0)(l  +  (Ii  -  l)p0)  2 

2  1  +  (A  -  i  -  l)Po  ls'° 

l(A-Q(l-po)(l  +  (A-l)p0) 

2  1  +  (A  —  i  —  l)p0 

where  we  assumed  that  po  >  --jA-j-  such  that  {K  —  i)(l  —  po)(l  +  (A'  -  l)po)/[l  +  (A'  -  i  —  l)po] 
is  positive  for  all  i  =  1,  2,  •  ■  • ,  K. 

From  (A. 8),  we  obtain 


Vs  ~  PO 


co\/(l  -  Po)(l  +  (A’  —  l)p0) 


(A. 8) 


u)  =  r/s, o  for  j  =  i  +  1,  i  +  2,  •  •  - ,  A", 


(A.9) 


with  which  we  can  easily  check  that  if  we  define 


u,-  = 


Po 


1  +  (A  -  j  -  l)p0 ,4 


K 

E 


ul  = 


(A  -  i)p0 


j+ 1 


1  +  (A  —  i  —  l)po 


*P,o  for;  =  1,2,< 


(A.10) 


(where  for  the  second  equality  the  computation  is  performed  in  reverse  index  order,  that  is,  for 
j  =  i,i-  1,  — ,  1),  then 


JoK)  =  /«(<). 


(A. 11) 


Moreover,  since  u*-  <  pSio  for  j  =  1,2, •••,*,  the  vector  u*  with  Uj  given  by  (A.9)  and  (A. 10) 
belongs  to  the  set  A  defined  in  (A. 3).  Consequently, 


f  f..\  (A-j)(l-po)(l  +  (A-  l)po)„2 

mf^/ofu)  -  /„(«  )  - - 2[1  +  (A',;_1)pj] - ”,.<>■ 


(A.12) 


We  therefore  conclude  that  as  n  — *  oo 


- In  Pol*  Os  are  transmitted} 

n 

=  fo  Po(Tn,l  5:  Vsi  An, 2  5:  Vsi‘  ‘  ‘  i  Pn,i  ^  Psj  i>  */s>  ‘  *  *  i  Tn,K  ^  Vs) 


n 


r,..,  (A  -  i)(l  —  Po)(l  +  ( A  —  l)p0)  _2 

int  io('U)  —  - -7- - — — - : - — - — z - rj  0 

ueA  uv  '  2[1  +  (A  -  j  -  l)p0]  s’° 


(A  -  Q 


1  +  (A  -  i  -  l)p0 


(*P  -  Po)2 


2^o 


(A. 13) 
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Following  similar  arguments  to  the  above  ones  we  can  verify  that  as  n  —  co 


— P\{i  0  s  are  transmitted}  — >  y  —  — — — -  •  —  ^ -9-  — . 


(A.14) 


Appendix  B:  Proof  of  Proposition  1 

If  the  optimal  threshold  is  given  by  (47),  then  from  (A. 13)  and  (A.14)  in  Appendix  A, 


lim 

n— +oo 


•lnPo{i  Os  are  transmitted} 


( K-i ) 


and 


lim 

n—y  oo 


n 


-Pi{i  Os  transmitted} 


_ (jf±  ~  Ho)2 

1  +  (K  -  i  -  l)p0  4(Jq 

i  (jig  -  p0)2 


1  +  (i  ~  l)pi 

Therefore,  when  there  are  i  0  s  transmitted  by  the  sensors,  we  have 


4  <?l 


(A.15) 


(A.16) 


—  In  Ln  = 
n 


—  —  lnPo{i  Os  are  transmitted} 
n 

_ (K  -  i  -  Q(1  -  po) _ 

(1  +  (K  -  i  -  l)p0)(l  +  (*  -  l)p0)  4 cr. 


— P\{i  Os  transmitted} 
n 


(He  ~  Ho)2 


2  ’ 
>^0 


(A.17) 


thus  the  asymptotic  likelihood  test  of  the  fusion  center  4-ln  Ln  0  is  equivalent  to  the  test 
>Ho 

K  -  i  <ul  i,  which  is  the  majority  rule 


no.  of  Is  <h0  no.  of  Os 


(A.1S) 


On  the  other  hand,  if  the  likelihood  ratio  test  is  equivalent  to  a  majority  rule  of  the  fusion 


center,  the  error  probability  of  the  fusion  center  is 

K  K 

Pj^^s  —  p  )  j  Po{(A  2)  Os  are  transmitted}  d-  (1  p)  E  05  are  transmitted} 

i=fA'/2l  «=rA72l 

(A- 19) 


for  odd  K,  where  \Kj 2]  =  ( K  +  l)/2,  and 

K  K 

Pk,V3  =  P  P0{(K  -  i)  Os  are  transmitted}  -f  (1  —  p)  P\{i  Os  are  transmitted} 

t=A/2+l  »= A/2+1 

+—Pq{K/2  Os  are  transmitted}  H - -—^-P\{Kj2  Os  are  transmitted }  (A. 20) 

2  2 
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for  even  Ii,  where  we  adopt  the  fusion  rule  of  flipping  a  fair  coin  (and  thus  incurring  an  error 
probability  of  1/2)  when  the  number  of  Is  and  the  number  of  Os  are  equal. 

From  (A. 13)  and  (A. 14)  and  for  the  special  case  of  weak-signal  detection,  for  which  p 1  =  pg, 
<7\  =  (Jo,  and  po  —  pi,  we  can  obtain  the  asymptotic  rates  for  each  of  the  terms  in  the  sums  in 
the  error  probability  expressions  in  (A. 19)  and  (A.20).  Since  j/(l  +  (j  —  l)po)  <  k/(l  +  (k  —  l)po) 
for  all  j  <  k,  the  overall  asymptotic  rate  of  the  total  error  probability  of  the  fusion  center  is 
given  by 


lim 

n— foo 


min< - In  Pq{(K  —  i)  Os  are  transmitted}, 


n 


—  lnPi{?  Os  are  transmitted};  for  i=  \ Kj 2] ,  \K/2\  +  1 ,  •  •  • ,  A 


n 


=  mm 


fA721(>7,  - 


[A/21(«  - 


[1  +  (fA/21  -  l)poK’  11  +  (W21  -  l)poko  j  ’ 


(A.21) 


for  any  K.  Consequently,  the  optimal  threshold  r?*  is  obtained  as 
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max 

(io<7],<ne 


max  min 


\K/2}(Vs-p0y 

[l  +  ([^/2l-l)poK2 


Mo  +  Pe 
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(A. 22) 


for  any  K. 
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breakpoints 

levels 

breckpoints 

levels 

0. 

0.1955  xlO-1 

0. 

0.1867  xlO"1 

0.1261 

0.5956  xlO-1 

0.9373  x  lO"1 

0.5676  xlO”1 

0.2894 

0.9205  x  10-1 

0.2013 

0.9461  xlO"1 

0.4953 

0.9395  xlO"1 

0.3340 

0.1298 

0.9514 

0.5378  xlO'1 

0.6054 

0.1196 

1.3044 

0.1191  xlO"1 

1.1727 

0.4398  xlO"1 

1.7963 

-0.2918  xlO"1 

1.9575 

-0.4021  xlO’1 

22.0413 

0.2369  xlO"2 

34.0785 

-0.4920  xlO"2 

Table  1:  16-level  Optimal  Quantizers  for  K  =  1,  2  in  Example  2 


qopt  for  I(  -  6 

q0pt  for  K  =  3 

breakpoints 

levels 

breakpoints 

levels 

0. 

0.7710  xlO-2 

0. 

0.1155  xlO-1 

0.8027  xlO-1 

0.2354  xlO’1 

0.8679  xlO”1 

0.3446  xlO"1 

0.1732 

0.3852  xlO"1 

0.1807 

0.5635  xlO"1 

0.2741 

0.5062  xlO"1 

0.2913 

0.7463  xlO"1 

0.9123 

0.1701  xlO”1 

1.0027 

0.2490  xlO’1 

1.3859 

-0.1740  xlO"1 

1.5836 

-0.2624  xlO"1 

5.8829 

-0.2725  xlO"2 

4.9459 

-0.2325  xlO"1 

30.0644 

-0.1529  xlO'3 

10.3475 

-0.2286  xlO'2 

Table  2:  16-level  Optimal  Quantizers  for  K  —  3,  6  in  Example  2 
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Fig.  3.4  Comparison  of  ROCs  for  Different  K  in  Example 


Fig.  4.1  Comparison  of  ROCs  for  Schemes  1—3  with  K 


Fig.  4.2  Comparison  of  ROCs  for  Schemes  1-3  with  K= 


